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DIMENSIONAL VECTOR AND VARIABLE RESOLUTION QUANTIZATION 

The present invention relates to the compression coding 
and/or decoding of digital signals such as audio, video 
signals, and more generally multimedia signals for 
their storage and/or their transmission. 

A very widespread solution in the compression of 
digital signals is vector quantization. A first 
incentive to use vector quantization may be found in 
block coding theory developed by Shannon according to 
which better performance may be achieved by boosting 
the dimension of the vectors to be coded. Vector 
quantization consists in representing an input vector 
by a vector of like dimension chosen from a finite set. 
Thus, providing a quantizer with M levels (or 
codevectors) amounts to creating a non-bi j ective 
mapping from the set of input vectors (generally the 
Euclidian real space with n dimensions R n , or else a 
subset of R n ) into a finite subset Y of R n . The subset Y 
then comprises M distinct elements: 

Y = {yi, y 2 , ... y M } • 

Y is called the reproduction alphabet, or else 
dictionary, or else directory. The elements of Y are 
called "codevectors", "code words", "exit points", or 
else "representatives " . 

The rate per dimension (r) of the quantizer (or else 
its "resolution") is defined by: 

r = — log 2 M 
n 

In vector quantization, a block of n samples is 
processed as a vector of dimension n. The vector is 
coded by choosing a codevector, from a dictionary of M 
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codevectors, the one which most "resembles" it. In 
general, an exhaustive search is made among all the 
elements of the dictionary to select the element of the 
dictionary which minimizes a measure of distance 
between it and the input vector. 

According to the theory of source coding, when the 
dimension becomes too large, the performance of the 
vector quantization approaches a limit termed the 
"bound of rate-distortion of the source". Apart from 
the dimensionality of the space, vector quantization 
may also utilize the properties of the source to be 
coded, for example nonlinear and/or linear 
dependencies, or else the shape of the probability 
distribution. In general, the dictionaries of vector 
quantizers are designed on the basis of statistical 
procedures such as the generalized Lloyd algorithm 
(denoted GLA) . This algorithm, well known, is based on 
the necessary conditions of optimality of a vector 
quantization. On the basis of a training sequence 
representative of the source to be coded and of an 
initial dictionary, the dictionary is constructed 
iteratively. Each iteration comprises two steps: 

the construction of the regions of quantization 
by quantization of the training sequence according to 
the rule of the nearest neighbour, and 

- the improving of the dictionary by replacing 
the old codevectors by the centroids of the regions 
(according to the rule of centroids) . 

To avoid the convergence to a local minimum of this 
deterministic iterative algorithm, variants termed 
"stochastic relaxation" (denoted SKA standing for 
"Stochastic K-means algorithm") inspired by the 
technique of simulated annealing have been proposed by 
introducing a randomness into the step of constructing 
the centroids and/or into that of constructing the 
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classes. The statistical vector quantizers thus 
obtained do not possess any structure, thereby 
rendering their exploration expensive in terms of 
calculations and memory greedy. Specifically, the 
complexity both of the coding and of the storage, is 
proportional to n.2 nr . This exponential increase as a 
function of the dimension of the vectors and of the 
rate limits the use of unstructured vector quantizers 
to small dimensions and/or low rates so as to be able 
to implant them in real time. 

Scalar quantization, which quantizes the samples 
individually, is not as effective as vector 
quantization since it can utilize only the shape of the 
probability distribution of the source and the linear 
dependency. However, scalar quantization is less 
expensive in terms of calculations and memory than 
vector quantization. Moreover, scalar quantization 
associated with entropy coding can achieve good 
performance even at moderate resolutions. 

To circumvent the constraints of size and of dimension, 
several variants of the basic vector quantization were 
studied, they attempt to remedy the absence of 
structure of the dictionary and thus succeed in 
reducing the complexity to the detriment of quality. 
However, the performance/complexity compromise is 
improved, thereby making it possible to increase the 
span of resolutions and/or of dimensions to which the 
vector quantization may be applied effectively in terms 
of cost of calculations or of memory. 

Numerous schemes of structured vector quantizers have 
been proposed in the literature. The main ones are the 
following: 

the tree vector quantizer which imposes a 
hierarchical tree structure on the dictionary: 
the search procedure is simplified but the 
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quantizer requires more storage memory, 

- the multi stage vector quantizer which cascades 
vector quantizers of lesser levels: the 
dictionaries are of reduced sizes and the same 
goes as regards the calculation time and the 
memory cost, 

- the vector quantizer termed the "Cartesian 
product" of N classical vector quantizers of 
smaller dimensions and sizes: the input vector 
is decomposed into N subvectors, each subvector 
being quantized independently of the others, 

- the "gain/orientation" vector quantizer 
constitutes a particular case of the "Cartesian 
product" vector quantizer: two quantizers are 
provided, one a scalar quantizer and the other 
a vector quantizer, which code separately, 
independently or otherwise, the gain (or the 
norm) of the vector and its orientation (by 
considering the normalized input vector) . This 
type of vector quantization is also called 
"spherical" vector quantization or. "polar" 
vector quantization, 

- the "permutation code" vector quantizer, whose 
codevectors are obtained by permutations of the 
components of a leader vector and its 
generalization to the composite (or the union) 
of permutation codes. 

The techniques described above all come within a 
statistical approach. 

Another radically different approach has also been 
proposed. This is algebraic vector quantization, which 
uses highly structured dictionaries, arising from 
regular lattices of points or error corrector codes. By 
virtue of the algebraic properties of their 
dictionaries, algebraic vector quantizers are simple to 
implement and do not have to be stored in memory. The 
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utilization of the regular structure of these 
dictionaries actually allows the development of optimal 
and fast search algorithms and of mechanisms for 
associating in particular an index with a corresponding 
5 codevector (for example through a formula) . Algebraic 
vector quantizers are less complex to implement and 
require less memory. However, they are optimal only for 
a uniform distribution of the source (either in space, 
or on the surface of a hypersphere) . Being a 

10 generalization of the uniform scalar quantizer, the 
algebraic vector quantizer is more difficult to tailor 
to the distribution of the source through the so-called 
" companding" technique. It is also recalled that the 
indexation (or numbering) of the codevectors and the 

15 inverse operation (decoding) require more calculations 
than in the case of statistical vector quantizers, for 
which these operations are performed by simple readings 
from a table. 

20 Certain aspects of a variable-dimension quantization 
and the problems encountered are presented hereinbelow. 

It is firstly indicated that vector quantization is a 
well known and effective technique for coding blocks of 

25 samples of fixed length. However, in numerous 
applications of digital signal compression, the signal 
to be coded is modelled by a sequence of parameters of 
variable length. Effective compression of these vectors 
of variable dimension is crucial for the design of many 

30 multimedia coders such as speech or audio coders ("MBE" 
coder, harmonic coder, sinusoidal coder, transform 
based coder, coder based on interpolation of prototype 
waveforms) . 

35 In sinusoidal coders, the number of sinusoids extracted 
depends on the number of sinusoidal spikes detected in 
the signal, which number varies in the course of time 
as a function of the nature of the audio signal. 
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Furthermore, numerous techniques of speech compression 
utilize the long-term periodicity of the signal. Such 
is the case for harmonic coders where the spectral 
5 components of a set of frequencies, which are the 
harmonics of the fundamental period of the talker, are 
coded. The number of spectral harmonic spikes being 
inversely proportional to the fundamental frequency, as 
this fundamental period varies according to the talker 
10 (typically, children having a higher frequency of 
vibration of the vocal cords than men) and over time, 
the number of components to be quantized also changes 
over time from frame to frame. 

15 Such is also the case for PWI coders (standing for 
"Prototype Waveform Interpolation") where the prototype 
waveforms are extracted over segments of length equal 
to the period of the pitch, hence also temporally 
variable. In PWI coders, the quantization of these 

20 waveforms of variable length is effected by separately 
coding the gain (or "RMS" standing for 
"Root-Mean-Square") and the normalized waveform which 
is itself decomposed into two waveforms of the same 
variable length: the REW waveform ("Rapidly Evolving 

25 Waveform") and the SEW waveform ("Slowly Evolving 
Waveform"). For a frame of fixed length, the number of 
prototypes is variable, hence the number of gains, of 
REW and SEW is likewise variable, as is the dimension 
of the REW and SEW waveforms. 

30 

In other types of coders, such as transform-based audio 
coders, the number of transform coefficients obtained 
over fixed-length frame lengths is imposed but it is 
usual to group these coefficients into frequency bands 
35 for their quantization. Conventionally, this splitting 
is performed into bands of unequal widths so as to 
utilize the psychoacoustic properties of human hearing 
by following the critical bands of the ear. The span of 
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variation of the dimension of these vectors of 
transform coefficients typically varies from 3 (for the 
lower frequency bands) to 15 (for the high frequency 
bands), in a wideband coder (50 Hz-7000 Hz), and even 
5 up to 24 in an FM band coder (covering the 
20 Hz-16000 Hz audible range) . 

Thoeretically, an optimal vector quantizer of variable 
dimension would utilize a set of dictionaries of fixed 

10 dimension, one for each possible dimension of the input 
vector. For example, in harmonic coders, for a pitch 
period of 60 to 450 Hz, the number of harmonic spikes 
in the telephone band varying from 7 for high-pitched 
voices (children) to 52 for low-pitched voices (men) , 

15 it would be necessary to construct, place in memory and 
implement 46 (46=52-7) vector quantizers. The design of 
each dictionary requires a learning sequence long 
enough to correctly represent the statistics of the 
input vectors. Moreover, the storage of all the 

20 dictionaries turns out to be impractical or very 
expensive in memory. It is therefore seen that in the 
case of variable dimension, it is difficiult to harness 
the advantages of vector quantization while complying 
with the constraints of memory storage and also of 

25 training sequences. 

Presented hereinbelow are certain aspects of a 
quantization with variable resolution and the problems 
encountered . 

30 

It is pointed out firstly that the variability of the 
input signal is not manifested solely through the 
variation in the number of parameters to be coded but 
also through the variation in the quantity of binary 
35 information to be transmitted for a given quality. For 
example in speech, onsets, voiced sounds and unvoiced 
sounds do not require the same rate for one and the 
same quality. Relatively unpredictable onsets require a 
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higher rate than voiced sounds that are more stable and 
whose stationarity may be exploited by "predictors" 
which make it possible to reduce the rate. Finally, the 
unvoiced sounds do not require high coding precision 
5 and hence need little rate. 

To utilize the temporal variation of the 
characteristics of multimedia signals such as voice or 
video, it is judicious to design variable rate coders. 
10 These variable rate coders are especially suited to 
communications over lattices, packetwise, such as the 
Internet, ATM, or others. 



Specifically, packet switching makes it possible to 
15 handle and process the information bits in a more 

flexible manner and hence to increase the capacity of 

the channel by reducing the mean rate. The use of 

variable rate coders is also an effective means of 

combating congestion of the system and/or of 
20 accommodating the diversity of access conditions. 

In multimedia communications, variable rate quantizers 
also make it possible to optimize the distributing of 
the rate between: 

25 

the source and channel codings: as in the concept 
of AMR ("Adaptive Multi Rate"), the rate can be 
switched on each 20-ms frame so as to be adapted 
dynamically to the traffic and channel error 
30 conditions. The overall quality of the speech is 

thus improved by ensuring good protection against 
errors, while reducing the rate for the coding of 
the source if the channel degrades; 

the various types of media signals (such as voice 
35 and video in video conferencing applications) ; 

the various parameters of one and the same signal: 
in transform based audio coders, for example, it 
is usual to distribute the bits dynamically 
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between the spectral envelope and the various 
bands of coefficients. Often, an entropy coding of 
the envelope is firstly performed and its 
objective is to utilize the nonuniform 
distribution of the code words by assigning 
variable length codes to the code words, the most 
probable ones having a shorter length than the 
least probable ones, thereby leading to the 
minimization of the mean length of the code words. 
Moreover, to utilize the psychoacoustic properties 
of the human ear, the remaining (variable) rate is 
allotted dynamically to the frequency bands of the 
coefficients as a function of their perceptual 
significance . 

New applications of multimedia coding (such as audio 
and video) require highly flexible quantizations both 
as regards dimension and rate. The range of rates 
having moreover to make it possible to achieve high 
quality, these multidimensional and multiresolution 
quantizers must be aimed at high resolutions. The 
complexity barrier posed by these vector quantizers 
remains, per se, a performance to be achieved, despite 
the increase in processing powers and memory capacities 
of the new technologies. 

As will be seen hereinbelow, most of the source coding 
techniques proposed are aimed either at solving the 
problems related to a variable dimension, or the 
problems related to a variable resolution. Few 
techniques proposed today make it possible to solve 
these two problems jointly. 

As regards vector quantization with variable dimension, 
known, the variability of the dimension of the 
parameters to be coded constitutes per se an obstacle 
to the use of vector quantization. Thus, the first 
versions of the transform based coder employ Lloyd-Max 
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scalar quantizers. A coder of this type, termed 
"TDAC", developed by the Applicant, is described in 
particular in: 

5 - "High Quality Audio Transform Coding at 

64 kbit/s", by Y . Mahieux, J. P. Petit, in IEEE Trans. 
Commun, Vol. 42, No 11, pp. 3010-3019, November 1994. 

Other solutions have been proposed to solve this 
10 problem of variable dimension vector quantization. The 
"IMBE" coder uses a complicated coding scheme with 
variable binary allocations and a scalar/vector hybrid 
quantization . 

15 An approach very commonly used to quantize vectors of 
variable dimension consists in pre-processing the 
vector of variable dimension so as to convert it into 
another vector of fixed dimension before quantization. 
There are several variants of this vector quantization 

20 technique associated with dimension conversion (this 
type of vector quantization being denoted DCVQ standing 
for "Dimension Conversion Vector Quantization") . 



25 



30 



Among the various dimension conversion procedures 
proposed, mention may in particular be made of: 
truncation, subsampling, interpolation, "length 



warping' 



For sinusoidal speech coders or MBEs, it has been 
proposed that the spectral coefficients be approximated 
by an all-pole model of fixed order and then a vector 
quantization of fixed dimension of the parameters of 
the model be performed. Another technique of vector 
quantization by nonsquare matrix transform solves the 
35 problem of vector quantization of variable dimension L 
by combining a vector quantization of fixed dimension K 
(K<L) with a nonsquare matrix linear transform (L*K) . 
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There is also another type of vector quantization 
associated with a dimension conversion which still uses 
a vector quantizer of fixed dimension K but the 
dimension conversion is applied to the codevectors to 
5 obtain codevectors having the same dimension as the 
input vector. 

The drawback of vector quantization associated with a 
dimension conversion is that the total distortion has 

10 two components: one due to the quantization, the other 
to the dimension conversion. To avoid this distortion 
due to dimension conversion, another approach of vector 
quantization of variable dimension consists in 
considering each input vector of variable dimension L 

15 as formed of a subset of components of an "underlying" 
vector of dimension K (L<K) and in designing and using 
just a single "universal" dictionary of fixed dimension 
K which nevertheless covers the entire span of 
dimensions of the input vectors, the correspondence 

20 between the input vector being effected by a selector. 
However, this "universal" dictionary encompassing all 
the other dictionaries of lower dimensions does not 
appear to be optimal for the lowest dimensions. In 
particular, the maximum resolution r max per dimension is 

25 limited by the storage constraint and by the rate per 
vector of parameters. For a dictionary of size 2 Krmax , 
the quantity of memory required to store this 
dictionary is K2 Krmax values and its rate per vector of 
parameters is Kr max . Thus, for one and the same size of 

30 dictionary (and hence one and the same rate per vector 
of parameters and per frame) , a vector of dimension L 
(L<K) could have a resolution (or a rate per dimension) 
K/L times larger, and this for K/L times smaller a 
volume of information to be stored. 

35 

As regards vector quantization with variable 
resolution, known, a simple solution consists in, as 
for the case of vector quantization with variable 
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dimension, using a scalar quantization, as for example 
-in the first versions of the TDAC transform based 
coder . 

5 However, the use of an integer resolution per sample 
entails a coarse granularity of resolution per band of 
coefficients which hinders the effectiveness of the 
dynamic binary allocation procedure. Thus the use has 
been proposed of scalar quantizers with an odd integer 

10 number of reconstruction levels, in combination with a 
procedure for arranging the coded indices as a joint 
binary train. The finer granularity of the resolution 
afforded, more propitious for the binary allocation 
procedure, has made it possible to improve the quality, 

15 at the price of the complexity of the algorithm for 
combining the indices, this algorithm being necessary 
for the arrangement into a binary train to be effective 
in terms of rate. Nevertheless, for elevated frequency 
bands having a larger number of coefficients, the 

20 constraint of an integer number of levels per sample, 
due to the scalar quantization, is still manifested 
through too coarse a granularity of the resolutions per 
band. 

25 Vector quantization make it possible to circumvent this 
constraint of a number of integer levels per sample and 
permits fine granularity of the resolutions available. 
On the other hand, the complexity of the vector 
quantization often limits the number of available 

30 rates. For example, the AMR-NB multirate speech coder, 
based on the well known ACELP technique, comprises 
eight fixed rates ranging from 12.2 kbit/s to 
4.75 kbit/s, each having a different level of 
protection against errors by virtue of a different 

35 distribution of the rate between the source coding and 
the channel coding. For each of the parameters of the 
ACELP coder (LSP, LTP delayers, excitation gains, fixed 
excitation) , dictionaries of different resolution have 
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been constructed. However, the number of available 
rates for each of these parameters is limited by the 
complexity of storage of the nonalgebraic vector 
quantizers. Moreover, in the AMR-WB multirate coder 
comprising nine rates ranging from 6.60 to 
23.85 kbit/s, the variation in the rates is essentially 
ensured by the algebraic excitation dictionaries which 
require no storage. There are eight dictionaries and 
therefore eight rates for the fixed excitation while 
the other parameters which use stochastic dictionaries 
(LSP, gains, absolute and differential delays) have 
only two possible rates. 

It is indicated that the stochastic vector quantizers 
used in AMR multirate coders are vector quantizers with 
constrained structure (Cartesian product and multiple 
stages) . A large family of variable rate quantizers can 
in fact be based on constrained structure vector 
quantizers such as the quantizers already mentioned 
having multiple stages, Cartesian products, but also 
tree-based vector quantizers. The use of these 
tree-based vector quantizers for variable rate coding 
has formed the subject of numerous studies. The binary 
tree-based vector quantizer was the first to be 
introduced. It derives naturally from the LBG algorithm 
for designing a vector quantizer by successive 
splittings of the centroids on the basis of the "root" 
node, the barycentre of the training sequence. Variant 
tree-type vector quantizers have been proposed based on 
pruning or on the contrary based on ramifying certain 
nodes of the tree according to their attributes such as 
their distortion, their population leading to nonbinary 
and/or nonequilibrated tree-based vector quantizers. 

Figures la and lb represent tree-structured vector 
quantizers. More particularly, Figure la represents an 
equilibrated binary tree, whereas Figure lb represents 
a nonbinary and nonequilibrated tree. 
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Multi-resolution vector quantizers are easily 
constructed on the basis of a tree-type vector 
quantizer, by selecting the number of nodes 
corresponding to the various resolutions desired. The 
tree-type hierarchical structure is appealing and 
simplifies the search procedure. On the other hand, it 
involves a suboptimal search and a significant increase 
in the necessary memories since all the nodes of the 
tree from the root-node to the terminal nodes via all 
the nodes of the intermediate levels must be stored. 
Moreover, as the set of nodes of a dictionary of lower 
resolution is not included in the dictionaries of 
higher resolution, the decrease in the quantization 
error as a function of the increase in the rate of the 
vector quantizer is not guaranteed locally. 

Moreover it is known how to construct variable 
resolution quantizers on the basis of algebraic codes, 
in particular EAVQ embedded algebraic vector quantizers 
which use subsets of spherical codes of the regular 
Gosset lattice in dimension 8. 



In the document: 

"A 16, 24, 32 kbit/s wideband speech codec based 
on ACELP" by P. Combescure, J. Schnitzler, K. Fischer, 
R. Kircherr, C. Lamblin, A. Le Guyader, D. Massaloux, 
C. Quinquis, J. Stegmann, P. Vary, in Proceedings IEEE 
International Conference on Acoustics, Speech, and 
Signal Processing, Vol. 1, pp 5-8, 1999, 

this embedded algebraic vector quantization approach 
has been extended to variable dimension quantization 
using algebraic codes of various dimensions. Even 
though this generalization of EAVQ quantization makes 
it possible to quantize vectors of variable dimension 
at variable resolutions, it has drawbacks. 
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The distribution of the input vectors must be uniform. 
However, to adapt the distribution of the source to 
this constraint is a very difficult task. The design of 
algebraic quantizers based on regular lattices also 
5 poses the problem of truncating and tailoring the 
regions of the various regular lattices to obtain the 
various resolutions desired, doing so for the various 
dimensions . 

10 The present invention aims to improve the situation. 

One of the aims of the present invention is, in a 
general manner, to propose an effective and economical 
solution (in particular in terms of storage memory) to 
15 the problem of the variable rate quantization of 
vectors of variable dimension. 

Another aim of the present invention is, in a 
nonlimiting manner, to propose a vector quantization 
20 that advantageously accommodates the coding and 
decoding of digital signals using a quantization of the 
spectral amplitudes of harmonic coders and/or of the 
transform coefficients of frequency coders, in 
particular of speech and/or audio signals. 

25 

To this end it proposes a dictionary comprising 
codevectors of variable dimension and intended to be 
used in a device for compression coding and/or decoding 
of digital signals, by vector quantization at variable 
30 rate defining a variable resolution, the dictionary 
comprising : 

on the one hand, for a given dimension, 
inter-embedded dictionaries of increasing resolution, 

and, on the other hand, for a given dimension, 

35 a union: 

• of a first set consisting of codevectors 
constructed by inserting, into codevectors of 
dictionaries of lower dimension, elements taken from a 
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finite set of real numbers according to a finite 
collector of predetermined insertion rules, 
• and of a second set consisting of codevectors that 
may not be obtained by insertion into codevectors of 
lower dimension of the elements of said finite set 
according to said collection of insertion rules. 

Preferably, said collection of insertion rules is 
formulated on the basis of elementary rules consisting 
in inserting a single element of the finite set of 
reals in the guise of component at a given position of 
a vector. 



Each elementary rule is preferably defined by a pair of 
two positive integers representative: 

of a rank of the element in said finite set, 

and of a position of insertion. 

It will be understood that the insertion rules thus 
characterized are read and are deduced directly from 
the actual structure of the dictionary within the 
meaning of the invention. 



Of course, in a purely reversible manner, it is 
possible to define deletion rules consisting in 
deleting one or more elements of a finite set of given 
dimension N 1 so as to attain a lower dimension N 
(N<N' ) . 



The present invention is also aimed at a method for 
forming a dictionary according to the invention, in 
which, for a given dimension: 

a) a first set consisting of codevectors formed by 
inserting/deleting into/from codevectors of 
dictionaries of lower/higher dimension elements taken 
from a finite set of real numbers according to a finite 
collection of predetermined insertion/deletion rules, 

b) a first, intermediate, dictionary comprising at 
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least said first set is constructed, for said given 
dimension, 

c) and, to adapt said dictionary to a use with at 
least one given resolution, a second, definitive, 
dictionary is constructed, on the basis of the 
intermediate dictionary, by embedding/simplification of 
dictionaries of increasing/decreasing resolutions, the 
dictionaries of increasing resolutions being 
inter-embedded from the dictionary of smallest 
resolution up to the dictionary of greatest resolution. 

Of course, the terms "embedding of a set A in a set B" 
are intended to mean the fact that the set A is 
included in the set B. Furthermore, the terms 
"simplification of a set A to obtain a set B" are 
intended to mean the fact that the set A includes the 
set B. 

By way of variant or supplement, it is understood that 
steps a) and b) , on the one hand, and step c) , on the 
other hand, may be substantially reversed to adapt said 
dictionary to a use with a given dimension N of 
codevectors . 



In this case: 

in step c) , a first, intermediate, dictionary 
still of dimension N 1 but of higher/lower resolution r N 
is constructed on the basis of an initial dictionary of 
resolution r N and of dimension N' by 

embedding/simplification of dictionaries of 

increasing/decreasing resolutions, so as to 

substantially attain the resolution r N of said first 
dictionary, 

in step a) , to attain the given dimension N, a 
first set consisting of codevectors formed by 
inserting/deleting, into/from codevectors of the first 
dictionary of dimension N' lower/higher than said given 
dimension N elements taken from a finite set of real 
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numbers according to a finite collection of 
predetermined insertion/deletion rules is constructed, 

- and, in step b) , subsequent to a possible step 
of definitive adaptation to the resolution r N , a second, 
definitive, dictionary comprising at least said first 
set is constructed for said given dimension N. 

It is possible to implement step a) by increasing 
successive dimensions. In this case, for a given 
dimension N: 

aO) an initial dictionary of initial dimension n, 
lower than said given dimension N, is obtained, 
al) a first set consisting of codevectors of dimension 
n+i formed by inserting into codevectors of the initial 
dictionary elements taken from a finite set of real 
numbers according to a finite collection of 
predetermined insertion rules is constructed, 
a2) there is provided a second set consisting of 
codevectors of dimension n+i that may not be obtained 
by insertion into the codevectors of the initial 
dictionary of the elements of said finite set with said 
collection of insertion rules, 

a3) an intermediate dictionary, of dimension n+i 
comprising a union of said first set and of said second 
set is constructed, 

and steps al) to a3) are repeated, at most N-n-1 times 
in which case (i=l), with said intermediate dictionary 
in the guise of initial dictionary, up to said given 
dimension N. 

It is also possible to implement step a) by decreasing 
successive dimensions. In this case, for a given 
dimension N: 

a'O) an initial dictionary of initial dimension n, 
higher than said given dimension N, is obtained, 
a'l) a first set, of dimension n-i, is constructed by 
selection and extraction of possible codevectors of 
dimension n-i from the dictionary of dimension n, 
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according to a finite collection of predetermined 
deletion rules, 

a' 2) there is provided a second set consisting of 
codevectors of dimension n-i, that may not be obtained 
5 simply by deletion, from the codevectors of the initial 
dictionary, of the elements of said finite set with 
said collection of deletion rules, 

a' 3) an intermediate dictionary, of dimension n-i 
comprising a union of said first set and of said second 
10 set is constructed, 

and steps a'l) to a' 3) are repeated, at most n-N-1 
times in which case (i=l) , with said intermediate 
dictionary in the guise of initial dictionary, up to 
said given dimension N. 

15 

To obtain a plurality of N dictionaries of successive 
dimensions 1 to N, it is possible to combine steps al) 
to a3) and steps a'l) to a 1 3), preferably on the basis 
of an initial dictionary of dimension n (n<N) and 
20 through the repeated implementation of steps al) to a3) 
for the dimensions n+1 to N, and through the repeated 
implementation of steps a'l) to a 1 3) for the dimensions 
n-1 to 1. 

25 One thus obtains all or part of N dictionaries of which 
the dictionary of largest dimension has dimension N. 

The finite set and the collection of insertion/deletion 
rules serving for the construction of dictionaries of 
30 successive dimensions may be defined: 

a priori, before constructing the dictionary, 
by analysis of a source to be quantized, 

or a posteriori, after the construction of 
dictionaries, preferably by embedding/simplification of 
35 dictionaries of successive resolutions, this 
construction then being followed by a statistical 
analysis of these dictionaries thus constructed. 
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It is indicated that the source to be quantized is 
preferably modelled by a learning sequence and the "a 
priori" definition of the finite set and of the 
collection of insertion/deletion rules is preferably 
effected by statistical analysis of the source. The 
aforesaid finite set is preferably chosen by estimation 
of a monodimensional probability density of the source 
to be quantized. 

By combining a priori and a posteriori definitions of 
the finite set and of the insertion rules: 

- a first set and a first collection of 
insertion/deletion rules may advantageously be chosen a 
priori by analysis of a learning sequence, so as to 
form one or more intermediate dictionaries, 

at least one part of said first set and/or of 
said first collection of insertion/deletion rules is 
updated by a posteriori analysis of said one or more 
intermediate dictionaries, 

- and, as appropriate, at least one part of the 
set of codevectors forming said one or more 
intermediate dictionaries is also updated. 

Preferably, step c) of adaptation to a given resolution 
comprises the following operations, to attain 
increasing resolutions : 

cO) an initial dictionary of initial resolution r n , 
lower than said given resolution r N , is obtained, 
cl) on the basis of the initial dictionary, an 
intermediate dictionary of resolution r n+1 higher than 
the initial resolution r n is constructed, 

c2) operation cl) is repeated until the given 
resolution r N is attained. 

Advantageously, for each iteration of operation cl), 
there is provided a construction of classes and of 
centroids, in which the centroids belonging at least to 
the dictionaries of resolution higher than a current 
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resolution r ± are recalculated and updated. Furthermore, 
the centroids which belong to the dictionaries of 
resolution lower than a current resolution r A are 
updated preferably only if the total distortions of all 
the dictionaries of lower resolution are decreasing 
from one update to the next. 

By way of supplement or variant, step c) comprises the 
following operations, now to attain decreasing 
resolutions : 

c'O) an initial dictionary of initial resolution r n , 
higher than said given resolution r N , is obtained, 
c'l) on the basis of the initial dictionary, an 
intermediate dictionary of resolution r n -i lower than 
the initial resolution r n , is constructed by 
partitioning of the initial dictionary into several 
subsets ordered according to a predetermined criterion, 
and 

c f 2) operation c'l) is repeated until the given 
resolution r N is attained. 

Advantageously, this partitioning may use the partial 
composition by controlled extension within the meaning 
of steps a) and b) , using a part at least of the 
insertion/deletion rules implemented . 

To obtain a plurality of N successive dictionaries of 
respective resolutions ri to r N on the basis of an 
initial dictionary of intermediate resolution r n between 
the resolutions ri and r N , it is advantageously possible 
to implement a repetition of step cl) for the 
increasing resolutions r n+x to r N , and through the 
repeated implementation of step c'l) for the decreasing 
resolutions r n -i to ri. 

It will be understood that the finite set and the 
collection of insertion/deletion rules may 
advantageously be chosen thorugh a study, a posteriori, 
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of a statistic of the thus obtained dictionaries of 
various resolutions and dimensions, to form a 
dictionary within the meaning of the invention, of 
desired dimensions and resolutions. 

5 

According to one of the advantages afforded by the 
present invention, the memory storage required for the 
implementation of the coding/decoding may be 
considerably reduced. Specifically, advantageously, 

10 there is stored in a memory, once and for all, said 
collection of insertion/deletion rules, each identified 
by an index, and, for a given dimension: 

said second set consisting of codevectors that 
may not be obtained by application of the 

15 insertion/deletion rules to codevectors of lower/higher 
dimension than the given dimension, 

as well as at least one correspondence table 
making it possible to reconstitute any codevector of 
the dictionary of given dimension, using the indices of 

20 the insertion/deletion rules and indices identifying 
elements of said second set. 

Thus the complete storage of the dictionary for said 
given dimension is avoided, by simply storing the 
elements of said second set and links in the 
25 correspondence table for access to these elements and 
to the associated insertion/deletion rules. 



Thus, it will be understood that, for a given 
dimension, the second aforesaid set may advantageously 
30 consist of "second" subsets of dimensions lower than 
said given dimension. 

In an embodiment, the insertion/deletion mechanism 
itself may be stored in the guise of program routine, 
35 while the insertion/deletion parameters, for a given 
insertion/deletion rule, may be stored in a general 
correspondence table (in principle different from the 
aforesaid correspondence table) , in combination with 
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the index of this given insertion/deletion rule. 

Preferably, the correspondence tables are formulated 
previously, for each index of a codevector of a 
dictionary of given dimension that may be reconstructed 
on the basis of elements of current indices in the 
second set of current dimension, through a tabulation 
of three integer scalar values representing: 

- a current dimension of said second set, 

- a current index of an element of the second 

set, 

an insertion/deletion rule index, 
this insertion/deletion rule at least contributing to 
reconstitute said codevector of the dictionary of given 
dimension, by applying the insertion/deletion to the 
element corresponding to said current index and to said 
current dimension. 

These latter characteristics may advantageously be 
implemented in a compression coding/decoding method, as 
described hereinbelow. 

In this regard, the present invention is also aimed at 
a use of the dictionary according to the invention and 
obtained through the implementation of the steps 
hereinabove, for the compression coding/decoding of 
digital signals, by vector quantization at variable 
rate defining a variable resolution. In particular a 
search is made for the codevector which is the nearest 
neighbour of an input vector y=(y 0 , Yj-i) in a 

dictionary of given dimension j. This use implements 
then the following steps: 

C01) for a current index of said codevector sought, 
reconstitution at least partial of a codevector of 
index corresponding to said current index, at least 
through the prior reading of the indices appearing in 
the correspondence tables and, where appropriate, of an 
element of the second set making it possible to 
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formulate said dictionary, 

the method continuing with coding/decoding steps 
proper, comprising: 

C02) at least on coding, calculation of a distance 
between the input vector and the codevector 
reconstituted in step C01) , 

C03) at least on coding, repetition of steps COl) and 
C02), for all the current indices in said dictionary, 
C04) at least on coding, identification of the index of 
the codevector at least partially reconstituted whose 
distance, calculated in the course of one of the 
iterations of step C02), with the input vector is the 
smallest, and 

C05) at least on decoding, determination of the nearest 
neighbour of the input vector (y) in the guise of 
codevector whose index has been identified in step 
C04) . 

As indicated hereinabove, it is recalled that the 
"second" aforesaid set preferably consists of "second" 
subsets of dimensions lower than a given dimension of 
the second set . 

In a particular embodiment, step COl), at least on 
decoding, comprises: 

COll) the reading, in the correspondence tables, of 
indices representative of links to said second set and 
to the insertion rules and including: 

- the index of a current dimension of a subset of 
said second set, 

- the current index of an element of said subset, 

- and the index of the appropriate insertion rule 
for the construction of the codevector of the 
dictionary of given dimension, on the basis of 
said element, 

C012) the reading, in the subset identified by its 
current dimension, of said element identified by its 
current index, 
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C013) the complete reconstitution of the codevector 
to said given dimension by applying to said element 
read in step C012) the appropriate insertion rule 
identified by its index read in step COll) . 

In a particular embodiment, on coding, 

* step C01) comprises: 

COll) the reading, in the correspondence tables, of 
indices representative of links to said second set and 
to the insertion rules and including: 

the index of a current dimension of a subset of 

said second set, 

the current index of an element of said subset, 

- and the index of the appropriate insertion rule 
for the construction of the codevector of the 
dictionary of given dimension, on the basis of 
said element, 

C012) the reading, in the subset identified by its 
current dimension, of said element identified by its 
current index, 

* in step C02), said distance is calculated as 
function of a distortion criterion estimated as a 
function of: 

of said insertion rule, 

- and of said element. 

Thus, it is possible to provide for only a partial 
reconstruction of the codevector with said given 
dimension in step COl), by reserving the complete 
reconstruction simply for decoding - 

In an advantageous embodiment, there is provided 
furthermore a supplementary structuring property 
according to a union of permutation codes and an index 
of this union of permutation codes is utilized in the 
implementation of the following steps: 

CP1) on the basis of an input signal, an input vector 
y=(yo, Yk, »■/ Yj-i) defined by its absolute vector 



a 
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I y I = ( l y 0 1 lykl,~, lyj-il) and b v a sign vector 

E=(eo,.»/Ek,..., ej-i) with e k =±l is formed, 

CP2) the components of the vector lyl are ranked by 
decreasing values, by permutation, to obtain a leader 
vector 1^1/ 

CP3) a nearest neighbour x j ' of the leader vector I y I 
is determined from among the leader vectors of the 
dictionary D j i of dimension j, 

CP4) an index of the rank of said nearest neighbour x D 
in the dictionary D 3 i is determined, 

CP5) and an effective value of coding/decoding is 
applied to the input vector, which is dependent on said 
index determined in step CP4), on said permutation 
determined in step CP2) and on said sign vector 
determined in step CP1) . 

According to another advantageous aspect of the 
invention, for the coding/decoding and possibly for the 
construction of the dictionary or dictionaries, there 
is provision to store the correspondence tables and the 
elements of the second set mentioned above, in 
particular in a memory of a compression coding/decoding 
device . 

In this regard, the present invention is also aimed at 
such a coding/decoding device. 

The present invention is also aimed at a computer 
program product intended to be stored in a memory of a 
processing unit, in particular of a computer or of a 
mobile terminal, or on a removable memory medium and 
intended to cooperate with a reader of the processing 
unit, this program comprising instructions for the 
implementation of the method of constructing 
dictionaries hereinabove. 

The present invention is also aimed at a program of 
this type, in particular a computer program product 
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intended to be stored in a memory of a processing unit, 
in particular of a computer or of a mobile terminal 
integrating a coding/decoding device, or on a removable 
memory medium and intended to cooperate with a reader 
of the processing unit, 

this program then comprising instructions for the 
implementation of the application to compression 
coding/decoding hereinabove . 

Other characteristics and advantages of the invention 
will become apparent on examining the detailed 
description hereinbelow, and the appended drawings in 
which, apart from Figures la and lb described 
hereinabove : 

Figure 2a illustrates the property of embedding 
of a dictionary within the meaning of the invention, 
for a given dimension N, 

- Figure 2b illustrates the property of partial 
composition by controlled extension of a dictionary 
within the meaning of the invention, 

Figure 3 illustrates the embedding of the 
dictionaries as a function of increasing resolutions, 

Figure 4 illustrates the composition of 
codevectors of a dictionary on the basis of codevectors 
of dictionaries of lower dimensions and of insertion 
rules, 

Figure 5 illustrates the construction according 
to increasing resolutions of embedded dictionaries 
without reupdating of the dictionaries of lower 
resolution, 

Figure 6 illustrates the block diagram of the 
"TDAC" coder, 

Figures 7a to 7g represent, for the broadband 
TDAC coder using a vector quantizer within the meaning 
of the invention, arrays illustrating respectively: 

* a splitting into 32 bands (Fig. 7a), 

* the resolutions per dimension (Fig. 7b), 



WO 2005/083889 



- 28 - 



PCT/FR2004/000219 



* the memory gain afforded by the embedding property 
(Fig. 7c), 

* the memory gain afforded by the two properties of 
embedding and of controlled extension (Fig. 7d) , 

5 * the memory gain afforded by the two structuring 
properties as a function of dimension and of rate, 
respectively, with respect to the memory size required 
for the storage of a dictionary without using these two 
properties (Fig. 7e) , 
10 * the first leaders of the set L° in dimensions 1, 2 
and 3 (Fig. 7f ) , and 

* the leaders of the permutation codes of the 
dictionaries in dimension 3 (Fig. 7g) , 

Figures 8a and 8b represent, for the FM band TDAC 
15 coder, arrays illustrating respectively: 

* a splitting into 52 bands (Fig. 8a), and 

* the resolutions per dimension (Fig. 8b) . 

Referring firstly to Figures 2a and 2b which illustrate 
20 the two main properties of a dictionary Di N within the 
meaning of the present invention. 

In Figure 2a, for a given dimension N, dictionaries Di N , 
D 2 N , Di N of respective increasing resolutions r lf r 2 , 

25 r± are embedded inside one another. Thus, the 

dictionary D ± N of maximum resolution r± may make it 
possible to determine a dictionary Dj N of lower 
resolution rj (j<i), as will be seen later. This first 
property, denoted PR, is dubbed hereinbelow "embedding 

30 property" . 

Referring now to Figure 2b, any dictionary Di N of a 
given dimension N and of resolution ri is the union of 
two disjoint sets: 

35 

o a first set D'i N consisting of codevectors Y N 
constructed (arrow F3) by inserting, into 
codevectors Y*" 1 , dictionaries D/" 1 of lower 
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dimension N-l of the elements x 3 taken (arrow 
F2) from a finite set A of real numbers 
according to a finite collection of insertion 
rules {Rm}, an insertion rule R' (j,k) 
determining the elements x-j to be inserted 
(arrow Fl) and the way of inserting them (for 
example at a position k of the vector Y N under 
construction) , 
o and a second set ~D ' i N consisting of vectors Y' 
that cannot be obtained by inserting into 
codevectors of lower dimension elements of this 
finite set according to the aforesaid 
collection of insertion rules. 

This second property, denoted PD, is dubbed hereinbelow 
"property of partial composition by controlled 
extension " . 

In Figures 2a and 2b and in the summary of the 
invention hereinabove, the indices for resolution 
and/or for dimension begin, by way of example, from the 
integer 1 up to a given integer (i, n, or N as the case 
may be) . The person skilled in the art of programming, 
in particular in the C++ language, will understand that 
these indices may start rather from 0 and reach 
n-l, or N-l, according to context. Thus, in the example 
of Figure 3 which will be described later, the largest 
resolution reached is Nj-1, starting from 0. 

Described hereinbelow is a method of constructing a 
dictionary possessing the two structuring properties PR 
and PD, in particular algorithms for constructing these 
dictionaries thus structured. The links induced by the 
two structuring properties are advantageously utilized 
to develop algorithms for constructing such 
dictionaries by adapting the iterative construction 
algorithms commonly used and described hereinabove such 
as "GLA" or "SKA". 
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In a general manner, it is indicated that: 

interrelated dictionaries of different resolutions 
and of the same dimension are constructed 
successively using the embedding property PR, 
as a supplement or variant, dictionaries of 
different dimensions, interrelated by the property 
PD of partial composition by controlled extension, 
are constructed, 

and thus dictionaries of various dimensions and 
resolutions possessing the two structuring 
properties PD and PR are obtained. 

In a general manner, to construct embedded dictionaries 
by increasing resolution for a given dimension (PR), 
three construction approaches are proposed. 

A first approach consists in constructing the 
dictionaries according to increasing resolutions (from 
the smallest resolution up to the maximum resolution) . 

A second approach consists conversely in constructing 
the dictionaries according to decreasing resolutions 
(from the maximum resolution down to the smallest 
resolution) . 

A third approach consists in constructing the 
dictionaries on the basis of a dictionary of 
intermediate resolution by decreasing the resolutions 
down to the minimum resolution and by increasing them 
up to the maximum resolution. This process is 
particularly beneficial when the nominal resolution of 
the vector quantizer of variable resolution is the 
aforesaid intermediate resolution. 

The property PR of embedding of the dictionaries, for a 
dimension j is finally conveyed by: 
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D 0 j c Di j c ...Di j e D j i+1 ...c: D 3 Nj -i 

Writing: 

Nj the number of resolutions (or of rates possible 
in a variable rate coder) for dimension j, 
the set of resolutions for dimension j 
Rj = {r 0 3 , r 1 V...r i j / r j i + i,...,rVih 
with ro j <ri j <.,.<ri j <r j i + i<...<r j Nj _i 

Dp the dictionary of dimension j, of resolution ri j 
Ti 11 the size of the dictionary of resolution 

r .3 {T J =2 Jr ' J i.e. r j i = -log 2 T j i) 

j 

Figure 3 illustrates the embedding of the dictionaries 
as a function of increasing resolutions. 

The flowchart of the algorithm for construction 
according to increasing resolutions without reupdating 
of the dictionaries of lower resolution is given in 
Figure 5. 

Referring to Figure 5, one firstly constructs the 
dictionary D 0 j of lowest resolution, subsequent to the 
initialization steps 51 and 52 where one firstly fixes 
i=0 and the loop iteration index iter=0. Then the 
dictionary D 0 3 of lowest resolution being fixed, the 
dictionary of immediately higher resolution D x j is 
constructed with the aid of a variant of a conventional 
construction algorithm described hereinbelow. The 
method is thereafter iterated until the dictionary of 
maximum resolution D j N j-i is constructed. 

Thus, in step 53 where, by an iterative process, one 
seeks to construct a dictionary Di j on the basis of an 
initial dictionary Di j (0), formed by appending (Ti j -Ti-i j ) 
vectors to the dictionary Di_i j of lower resolution r±- x . 
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The algorithm for constructing classes 54 is identical 
to a conventional algorithm but the algorithm for 
constructing the Ti j centroids 55 is modified. 
Specifically, the (T± 3 -Ti-i 3 ) centroids not belonging to 
the dictionaries of lower resolution are recalculated 
and updated, while the (Ti-i j ) centroids of the 
dictionaries of lower resolution are not reupdated. A 
variant permits the reupdating of the centroids of the 
dictionaries of the lower resolutions in the case where 
the total distortions of all the dictionaries of lower 
resolution decrease or remain constant. In this case, 
the dictionaries of lower resolutions are modified 
accordingly. 

The loop index iter is thereafter incremented (step 56) 
up to a number Niter (i,j) dependent on the i th 
resolution and on the dimension j (test 57) . Once the 
desired resolution Nj is reached (test 58), we obtain 
the dictionary at this resolution Nj (end step 59), and 
hence the set of dictionaries D ± j of resolution x±, for 
i ranging from 1 to Nj . 

To construct the dictionaries according to decreasing 
resolutions, one firstly constructs the dictionary of 
highest resolution. Then the latter being fixed, one 
performs a partition of the latter into several subsets 
that are ordered according to a certain criterion. 
Several criteria may serve to order the partition. It 
is for example possible to order the subsets according 
to their cardinal, their invoking in the learning 
sequence (that is to say the cardinal of their 
quantization regions), their contribution to the total 
distortion or more precisely to the decrease in this 
distortion. It is obviously possible to combine various 
criteria and weight their respective significance. 
Likewise, the partitioning of the dictionary may be 
performed in various ways: from elementary 

partitioning (one element in each subset) to more 
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elaborate partitioning. This ordered partitioning is at 
the basis of the construction of the embedded 
dictionaries by progressive union of its ordered 
classes . 

5 

Preferably, the partition may be based on the property 
PD of partial composition by controlled extension by 
grouping together the elements based on the extension 
of one and the same codevector on the basis of a subset 
10 of the collection of insertion rules (possibly equal to 
this set itself) . 

It should be noted that it is possible to do several 
iterations by alternating the various procedures. For 

15 example, embedded dictionaries are constructed 
according to the increasing resolutions procedure then 
the decreasing resolutions procedure is applied. By 
combining the two methods above, dictionaries embedded 
by resolution are constructed on the basis of a 

20 dictionary of intermediate resolution r ± . This i th 
dictionary is therefore firstly constructed. Then, on 
the basis of this dictionary, the dictionaries of lower 
resolution are constructed with the aid of the second 
method by decreasing resolutions and the dictionaries 

25 of higher resolutions with the aid of the first method 
by increasing resolutions. 

In a general manner, three approaches are also proposed 
for constructing dictionaries of various dimensions by 
30 partial composition by controlled extension (property 
PD) . 

A first approach consists in increasing the dimensions. 
Another approach consists in decreasing them. Finally, 
35 a last approach consists in beginning by constructing 
the dictionary of an intermediate dimension and 
constructing by successive increasing and decreasing of 
the dimension the dictionaries of higher and lower 
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dimensions. The partial composition by controlled 
extension has led to a fine-tuning of the procedures 
for determining the finite set of reals and of the 
collection of insertion rules that will be seen 
hereinbelow. It is simply indicated here that, 
preferably, the proportion of "extended" elements 
(number of elements of the first set with respect to 
the cardinal of the dictionary) is increasing with 
dimension, thereby making it possible to reduce the 
cost of storage of the second set, increasing with 
dimension. This proportion may be fixed a proiri by the 
complexity constraints of the application 

(memory/calculation power) or left "free". In the 
latter case, the construction algorithm advantageously 
favors the elements of the first set comprising the 
elements obtained by controlled extension, as will be 
seen hereinbelow. 

Thus, the second property PD of partial composition by 
controlled extension is finally conveyed by: 

by writing: 

D' j ± the set of codevectors of Dp which may be 
obtained by inserting into codevectors of dictionaries 
of lower dimensions elements taken from a finite set A 
of R according to a collection of insertion rules {R m }, 

- D % \ its complement in I? ± , the set of codevectors of 
Dp that cannot be obtained by inserting into 
codevectors of lower dimension elements of A according 
to the collection of insertion rules {R m }. 

Described hereinbelow is an example of insertion rules 
for verifying the second property PD. 
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Firstly, a collection of elementary insertion rules is 
defined: each elementary rule consists in inserting one 
and only one element of the finite set of reals A as 
component at a given position of a vector. Each 
elementary rule is given by a pair of two positive 
integers, one giving the rank of the element in the 
finite set and the other the position of insertion. On 
the basis of this collection of elementary rules, it is 
possible to compose any more elaborate rule for 
inserting components . 

Of course, in a purely reversible manner, it is 
possible to define deletion rules consisting in 
deleting one or more elements of a finite set of given 
dimension N to reach a lower dimension N-n. 

To define an insertion rule, we then write: 

N a the cardinal of A and a± its i th element: 
A = {ao, ai, ai..., a Na -i } , 

~ R ( lm/ Pm ) the elementary insertion rule which 

consists in inserting a im at position p m . 

Thus, if the maximum dimension is jmax, the number of 
possible elementary rules is N a *j max . For example, for 
N a =2 and j m ax=3, six possible elementary rules are 
counted in all: 

R' (0,0) : insert a 0 at position 0, 

R'(lfO): insert ai at position 0, 

R'(0,1): insert a 0 at position 1, 

R'(l/1): insert ai at position 1, 

R f (0,2): insert a 0 at position 2, 

R'(l,2): insert ai at position 2 

The composite of rules R'(0,0) and R f (0,l) gives the 
rule: insert a 0 at positions 0 and 1. It makes it 
possible thus to obtain a codevector of dimension j+2 
on the basis of a codevector of dimension j . 
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The composite of rules R'(1,0) and R'(0,2) gives the 
rule: insert ai at position 0 and a 0 at position 2. It 
makes it possible thus to obtain a codevector of 
dimension j+2 on the basis of a codevector of dimension 
5 j. 

More generally, we write R(n, { (i m ,p m ) }m=0 , n=l) for the 
composite of the n elementary rules R 1 (i m ,p m ) (from m=0 
to n-1) , which makes it possible to obtain a codevector 
10 of dimension j+n on the basis of a codevector of 
dimension j . It should be noted that the i m are not 
necessarily different, by contrast the n positions p m 
are distinct. Preferably, the positions p m are arranged 
in increasing order, i.e.: 

15 

P0<Pl- • • <Pm...<Pn-l- 

Figure 4 illustrates the composition of codevectors of 
a dictionary on the basis of codevectors of 
20 dictionaries of lower dimensions and of insertion 
rules . 

There are also provided several embodiments for 
constructing dictionaries of various dimensions, unions 

25 of two disjoint sets, a first set consisting of 
codevectors constructed by inserting at codevectors of 
the dictionaries of the lower dimensions elements taken 
from a finite set of real numbers according to a 
collection of insertion rules, a second set consisting 

30 of vectors that cannot be obtained by inserting at the 
codevectors of lower dimension elements of this finite 
set of real numbers according to this collection of 
insertion rules. 

35 The first set requires the determination of the finite 
set of reals (that is to say its cardinal and its 
values) as well as of the collection of insertion 
rules . 
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The construction of this finite set and the formulation 
of the collection of insertion rules are performed: 

either "a priori": the finite set and the 
collection of insertion rules are determined 
before constructing the dictionaries. This choice 
is based preferably on an analysis of the 
statistics of the source to be quantized, modelled 
for example by a learning sequence. For example, 
the choice of the finite set may be based on the 
monodimensional probability density of the source 
(or its histogram) ; 

or "a posteriori": one firstly constructs the 
dictionaries embedded by resolution for all the 
dimensions without imposing the need to follow the 
rule of partial composition by controlled 
extension. The choice of the finite set and of the 
collection of insertion rules is then made by a 
study of the statistic of these "initial" 
dictionaries . 

The two solutions "a priori" or "a posteriori" may be 
used successively and/or combined. For example, a first 
set and a first collection of insertion rules may be 
25 chosen by an analysis of the learning sequence, then 
after a first construction of the dictionaries, an 
analysis of these dictionaries may lead to a total or 
partial update of the set A and/or of the collection of 
insertion rules. 

30 

It should also be noted that the finite set and/or the 
collection of insertion rules may be dependent or 
otherwise on the dimensions. It is then possible to 
determine a collection and/or a set that is specific 
35 for each pair of dimensions or a collection 

and/or a set that is specific by difference of 
dimension, or to determine a global set. Here again, 
the choice is made a priori or after statistical 
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analysis of the learning sequence and/or of the 
dictionaries . 

To construct the dictionaries according to increasing 
5 dimensions, one firstly constructs the dictionary of 
lowest dimension by a conventional procedure of vector 
quantization design, as indicated above. Then, this 
dictionary being constructed, the dictionary of 
immediately higher dimension is constructed with the 

10 aid of a variant of a conventional construction 
algorithm. On the basis of the dictionary of lower 
dimension, all the possible initial codevectors are 
composed by applying the insertion rules, this 
dictionary may possibly be supplemented with "jfree" 

15 codevectors (that is to say those which cannot be 
obtained by extension) . It should be noted that the 
size of this initial dictionary may be greater than the 
desired size. On the basis of the initial dictionary, a 
variant of an iterative algorithm for constructing a 

20 vector quantizer is then applied. Classes are 
constructed by quantization of the learning sequence 
and centroids are updated by complying with the 
controlled extension constraint for the codevectors of 
the first set. For these codevectors of the first set, 

25 it is possible either not to recalculate the components 
obtained by insertion, or to recalculate all the 
components and modify the codevectors thus obtained so 
as to bring back the components obtained by the 
insertion rules. One thus eliminates the empty classes 

30 if the size of the dictionary is greater than the 
desired size. If at the end of the algorithm, the size 
of the dictionary is greater than the desired 
resolution, a procedure for classing elements of the 
dictionary is applied so as to retain only the first 

35 codevectors. The iterative algorithm is possibly rerun. 
One then passes to the construction of the dictionary 
of the higher dimension, the initial dictionary is then 
constructed by controlled extension on the basis of the 
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two dictionaries of the two smallest dimensions and 
supplemented with "free" codevectors, then the variant 
of the iterative algorithm for constructing a vector 
quantizer is applied. The method is then iterated, 
5 until the dictionary of maximal size is constructed. 

As a variant, to construct the dictionaries according 
to decreasing dimensions, one firstly constructs the 
dictionary of largest dimension. Then, the latter being 
10 fixed, the possible codevectors of lower dimension are 
extracted. Advantageously, the extraction procedure is 
facilitated by modifying the codevectors of the higher 
dimensions so as to bring out elements of A as 
components of these codevectors. 

15 

In a complementary variant, several iterations are 
advantageously performed by alternating the two 
constructions according to increasing dimensions, on 
the one hand, and according to decreasing dimensions, 
20 on the other hand. 

To facilitate the controlled extension procedure, the 
invention may in addition carry out a transformation of 
the components of the codevectors. An exemplary 

25 transformation is a scalar quantization at high 
resolution. It is beneficial to construct 
"dictionaries" of lower dimensions even if these 
dimensions are not used directly by the vector 
quantization. For example, it is possible to begin with 

30 the dimension 1 even if the scalar quantization is not 
used. Likewise, it may also be beneficial to construct 
dictionaries of intermediate dimensions. These 
"dictionaries" are moreover advantageously used by the 
controlled extension procedure to reduce the complexity 

35 of storage and of calculations. 

It is indicated moreover that by judicially combining 
algorithms for constructing dictionaries by embedding 
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by resolution (PR) with algorithms for construction by 
partial composition by controlled extension (PD) , 
several construction methods may be developed. It 
should be noted that the algorithms being iterative, 
5 various techniques may be alternated. For example, one 
begins by constructing the dictionary of maximal 
resolution for the smallest dimension, from this one 
deduces the dictionaries embedded by decreasing 
resolutions (property PR) , then one constructs the 

10 dictionary of maximal resolution for the immediately 
higher dimension by virtue of the property PD, for this 
dimension, one constructs the dictionaries embedded by 
resolution and one iterates until the dictionaries 
(embedded by resolution) of maximal dimension are 

15 obtained. 

A preferential construction is used in the embodiment 
described below which combines the techniques of 
dictionary construction according to increasing 
20 dimensions and decreasing resolutions to construct the 
set of dictionaries 

* D3± }±=0r Nj-i, j=jminf jmax- 

Described below is the compression coding/decoding of 
25 digital signals (audio, video, etc.), using 
dictionaries within the meaning of the invention, in 
particular the coding and decoding algorithms which 
utilize the structure of the dictionaries (embedding 
and partial composition by controlled extension) . In a 
30 general manner, it will be understood that optimization 
of the compromise between memory/calculations at the 
coder and/or at the decoder is undertaken according to 
the constraints of the application. 

35 By way of example, considered hereinbelow is the audio 
coder dubbed " TDAC coder" used to code digital audio 
signals sampled at 16 kHz (in wideband) . This coder is 
a transform based coder which can operate at various 
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rates. In particular, the rate may be fixed before the 
establishing of the communication or vary from frame to 
frame in the course of communication. 

Figure 6 gives the block diagram of this TDAC coder. An 
audio signal x(n) band limited at 7 kHz and sampled at 
16 kHz is split into frames of 320 samples (20 ms) . A 
modified discrete cosine transform 61 is applied to 
blocks of the input signal of 640 samples with an 
overlap of 50% (that is to say a refreshing of the MDCT 
analysis every 20 ms) . The spectrum obtained y(k) is 
limited to 7225 Hz by zeroing the last 31 coefficients 
(only the first 289 coefficients are different from 0) . 
A masking curve is determined by the masking module 62 
which then performs a zeroing of the masked 
coefficients. The spectrum is divided into thirty-two 
bands of unequal widths. The masked bands, if any, are 
determined as a function of the transformed 
coefficients of the signal x(n). For each band of the 
spectrum, the energy of the MDCT coefficients is 
calculated (one speaks of scale factors) . The 
thirty-two scale factors constitute the signal's 
spectral envelope which is thereafter quantized, coded 
and transmitted in the frame (block 63) . This 
quantization and this coding use a Huffman coding. The 
variable . number of bits remaining after the 
quantization of the spectral envelope at variable rate 
is then calculated. These bits are distributed for the 
vector quantization 65 of the MDCT coefficients of the 
spectrum. The dequantized spectral envelope serves to 
calculate the set of bandwise masking thresholds, this 
masking curve determining the dynamic allocation of the 
bits 64. The calculation of this masking curve band by 
band and on the basis of the quantized spectral 
envelope avoids the transmission of auxiliary 
information relating to the binary allocation. 
Specifically, the decoder calculates the dynamic 
allocation of the bits in an identical manner to the 
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coder. The MDCT coefficients are normalized by the 
dequantized scale factors of their band then they are 
quantized by vector quantizers of variable dimension 
and variable rate. Finally, the binary train is 
5 constructed by multiplexing 66 of the information on 
the spectral envelope and these bandwise normalized 
coefficients coded and transmitted in a frame. It is 
indicated that the references 67 and 68 in Figure 6 
correspond to steps known per se of detection of a 
10 voiced or unvoiced signal x(n), and of detection of 
tone (determination of tonal frequencies) , 

respectively. 

Described hereinbelow are the vector quantizers with 
15 variable rate based on bands of unequal widths of the 
MDCT coef f iciencies in the TDAC coder. The quantization 
of the bandwise normalized MDCT coefficients uses in 
particular dictionaries constructed according to the 
invention. The splitting into bands of unequal widths 
20 leads in fact to vectors of various dimensions. The 
array of Figure 7a which gives the band splitting used 
indicates also the resulting dimension of the vector of 
coefficients, that is to say the number of 
coefficients, as indicated by the third column. 

25 

The variable number of bits remaining after the Huffman 
coding of the spectral envelope is allocated 
dynamically to the various bands. The array of Figure 
7b gives the numbers of resolutions Nj and the sets of 

30 rates per band j*Rj (hence the values of the resolutions 
per band) for the dimensions j , for j ranging from 1 to 
15. It will be noted that to advantageously utilize the 
structuring property of partial composition by 
controlled extension, vector quantizers have been 

35 constructed in dimensions 1, 2, 6, 11, which, 
nevertheless, do not correspond to any bandwidth, but 
whose elements serve to compose codevectors of larger 
dimension. Also noted is the fineness of the 
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granularity of the resolutions even for large 
dimensions . 

The zeroing of the masked coefficients in the module 62 
5 leads to the choice, during the analysis of the 
normalized MDCT coefficients, as starting set A={0} and 
as collection of insertion rules, of all the possible 
compounds of the elementary insertion rules. This 
amounts here to inserting zeros at an arbitrary 
10 position. 

However, a finer analysis imposes an additional 
structural constraint on the dictionaries, by using 
dictionaries formed of a union of normalized 

15 permutation codes, of type II according to which all 
the permutations and all the signs are permitted. For 
each permutation code of type II, the largest vector, 
within the lexicographic sense, is called the absolute 
leader and is obtained by ordering the absolute values 

20 of the components in decreasing order. The construction 
of the dictionaries amounts to determining their 
normalized absolute leaders. Applying the controlled 
extension to these absolute leaders then consists in 
inserting zeros into them as last components. 

25 

Moreover, a distortion criterion is fixed. Preferably, 
the distortion criterion chosen is here the Euclidian 
distance. The dictionary being normalized, the search 
for the codevector which minimizes the Euclidean 

30 distance with an input vector to be quantized amounts 
to searching for the codevector which maximizes the 
scalar product with this input vector. Moreover, the 
dictionary being the union of permutation codes, the 
search for the codevector maximizing the scalar product 

35 with an input vector amounts to searching among the 
absolute leaders of the dictionary for that one which 
maximizes the scalar product with the absolute leader 
of this input vector (which is also obtained by 
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permutation of the absolute values of its components so 
as to rank them in decreasing order) . 

Defined hereinbelow is a learning sequence for the 
5 design of vector quantizers within the meaning of the 
invention. As indicated hereinabove, it is preferable 
to determine a learning sequence for the design of a 
quantizer. A long sequence consisting of frames of 289 
MDCT coefficients normalized by the scale factor of 

10 their band is firstly obtained on the basis of numerous 
samples of wideband audio signals. Then, for each 
normalized vector of coefficients, its absolute leader 
is deduced. On the basis of the set of absolute leaders 
of various dimensions, two categories of 

15 multidimensional learning sequences S° and S 1 are 
created: 

S° = {S°j} je [1, 15] , S°j being the set of all the 
vectors formed by the first j components of the 

20 absolute leaders having j nonzero coefficients. S°j thus - 
consists of the absolute leaders of dimension j having 
no zero coefficient, those of dimension j+1 having a 
single zero coefficient, those of dimension j+2 having 
two zero coefficients, ... those of dimension 15 having 

25 15-j zero coefficients, 

and S 1 = {S 1 -)} je [3, 4, 5,7, 8, 9, 10, 12, 13, 14, 15] , S X j 
being the set of all the absolute leaders of the bands 
having j coefficients. 

30 

For example, on the basis of the normalized vector of 
coefficients (0 . ; 0 . 6; 0 . ; 0 . ; 0 . 8) , we deduce its absolute 
leader ( 0 . 8 ; 0 . 6; 0 . ; 0 . ; 0 . ) which belongs to the sequence 
S 1 5 and an element of S° 2/ (0.8; 0.6) formed by the first 
35 two nonzero components of its absolute leader. 



The first category of sequences is preferably used to 
determine the initial dictionaries of leaders of the 
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D %j Nj . The second category is preferably used to 

construct multidimensional and multiresolution 
dictionaries possessing the two structuring properties. 

5 On the basis of the first category S° of sequences, we 
obtain a first dictionary of normalized absolute 
leaders for each dimension j (j ranging from 1 to 15) 
by applying to the sequence S°j a conventional algorithm 
such as the so-called "k-means algorithm" . These 

10 leaders with positive real components are modified by 
suppressing the components below a predetermined 
threshold, with respect to the first component (that is 
to say the largest component) . This so-called 
"center-clipping" procedure advantageously makes it 

15 possible to bring out zeros and to extract absolute 
leaders without zero components of lower dimension. To 
further favor the controlled extension, a 
transformation of the components of , these extracted 
leaders is applied. For this purpose one uses a 

20 normalization of each leader by its smallest nonzero 
component followed by a uniform scalar quantization of 
interval 1 with integer reconstruction levels (this 
amounting to rounding the components of each leader to 
the nearest integer) . This transformation brings about 

25 moreover a sizeable reduction in the memory since the 
absolute leaders may thus be stored in the form of 
integers by introducing a corrective normalization 
factor into the distance calculation. It will be noted 
that different real leaders obtained or otherwise on 

30 the basis of various sequences S°j may be transformed 
into one and the same integer leader. There is then 
provided a procedure for eliminating possible 
redundancies and for forming the set L ,0 = Y^'y °f a H 

Ml,. 15] 

the absolute leaders with nonzero integer components, 
35 L f0 j being the subset consisting of these leaders of 
dimension j. This technique for constructing L 1 0 takes 
its inspiration from the technique of constructing 
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dictionaries by partial composition by controlled 
extension according to decreasing dimensions. It is 
also noted that the choice of the set A made a priori 
could be reviewed a posteriori so as to append thereto 
5 the element "1" since all the leaders of L ?0 have at 
least one "1" as last component. 

The set L f0 serves as basis for the composition of the 
initial dictionaries of leaders for the design of 

10 vector quantizers with multiple dimensions and 
resolutions possessing the two structuring properties 
of embedding PR and of partial composition by 
controlled extension PD. On the basis of the sequence 
S 1 , the algorithm for constructing these quantizers 

15 proceeds through increasing dimension and decreasing 
resolution. 

For a dimension j , the initial dictionary of leaders 
L fl j is formed by all the leaders of L ,0 j and by all the 

20 leaders obtained by controlled extension of the leaders 
of the lower dimensions j'(j'<j) by inserting (j-j 1 ) 
zeros with the leaders of the sets L ,0 j>. For example in 
dimension 3, a dictionary of leaders is composed by 
controlled extension on the basis of 

25 L'°!={ (1) },L'° 2 ={ (ID , (21) , (31) , (41) , (51) , (91) }, 
supplemented with the leaders of L ,0 3 . 

For each dimension j, the union of the permutation 
codes, characterized by L ,:L j, constitutes a dictionary 

30 of high resolution, possibly greater than the maximal 
resolution desired. These permutation codes therefore 
perform a natural partition of this dictionary, each 
class of this partition being a permutation code 
represented by its leader. The construction of the 

35 regions of the nearest neighbour corresponding to the 
classes of this partition is then performed by 
quantization of the sequence S 1 . The partition is 
ordered according to the increase in cardinal of the 
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permutation codes. In case of equality of the cardinals 
of the permutation codes, the codes of the leaders 
obtained by controlled extension are favored with 
respect to those of the leaders of L ,0 j as indicated 
5 hereinabove. In case of equality of cardinals of two 
classes belonging to the same set (either to 
D tJ NJ , or toD %j NJ ) , the classes are ordered according to a 

criterion combining the cardinal of their quantization 
region and their contribution to the decrease in the 

10 total distortion. The aggregate of the cardinalities of 
the permutation codes thus ordered is calculated for 
each permutation code as is the corresponding rate per 
vector. We denote by L X j the set of thus ordered leaders 
of L fl j. To avoid a procedure for arranging the coded 

15 indices as a conjoint binary train, one chooses to use 
only integer resolutions. 

The multiresolution dictionaries embedded by 
resolution, with reference to the array of Figure 7c, 

20 are therefore constituted by choosing as last 
permutation code of each different resolution that one 
whose rate of the aggregate of the cardinals is nearest 
the immediately higher integer. If the resolution of 
the dictionary characterized by L X j is higher than the 

25 maximal resolution desired, the last unused permutation 
codes are eliminated. We denote by Lj ( c= L ] j ) the final 

ordered set of the leaders of D j Nj _i. At the end of the 
iterations on the dimensions, if certain leaders of L ,G 
are not used to compose leaders of 

30 {Lj}je{3,4,5,7,8,9,10,12,13,14,15}, the set L'° is 
updated by eliminating them. We write this set as L°= 

ye[l,...15] 

The arrays of Figures 7c to 7e show the memory savings 
35 afforded by the embedding property and by the property 
of partial composition by controlled extension. The 
array of Figure 7c compares vector quantizers with 
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multiple resolutions for various dimensions: the first 
quantizers simply structured as unions of permutation 
codes, and the second quantizers possessing moreover 
the property of embedding by resolution. 

5 

In Figure 7c, we write: 
-j : the dimension, 

-N j : the number of resolutions in dimension j , 
-^Df : the number of leaders of the dictionary D j i, 

10 ~^d j : the num k er of leaders of the dictionary D j Nj _i, 

-j ^L D j : the memory (in number of words) required to 

store the leaders of all the dictionaries in dimension 
j without the embedding property, 

-j : the memory required to store the leaders of all 

15 the dictionaries in dimension j with the embedding 
property. 

The array of Figure 7d compares these latter 
quantizers, used for multiple dimensions, with 
20 quantizers also possessing the structuring property of 
partial composition by controlled extension. 

In Figure 7d, we write: 
-j : the dimension 

25 ~^d j : the number °f leaders of the dictionary D j N j-i, 

j 

- ^ L Dk : the sum of the numbers of leaders of the 

dictionaries of maximal resolution of dimensions 1 to 
If 

- kL Dk the memory required to store these leaders 

30 without the property of partial composition by 
controlled extension, 

-Lj : the number of leaders of the set L°j, 
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J 

~^L k : their sum for the dimensions 1 to j , 
*=i 

j 

~^kL k : the memory required to store the leaders of all 
*=i 

the dictionaries of dimensions 1 to j with the property 
of partial composition by controlled extension. 

5 

The array of Figure 7e compares vector quantizers with 
multiple resolutions and dimensions: the first 
quantizers simply structured as a union of permutation 
codes and the second quantizers possessing moreover the 
10 structuring properties of embedding by resolution and 
of partial composition by controlled extension. 

In Figure 7e, we write: 
-j : the dimension 
15 -Nj : the number of resolutions in dimension j 

Nj 

-^L D j : the number of leaders in dimension j to be 

stored for the Nj resolutions without the property of 
embedding or the property of controlled partial 
extension 

Nj 

20 - j^L^j : the memory (in number of words) required to 
/=! 

store these leaders of all the dictionaries in 
dimension j without these two properties 

Z-< D k 1 t ^ le mem ° r y (number of words) required to 
*=i i=i ' 

store the leaders of all the dictionaries of dimensions 

25 1 to j without these two properties 

Lj : the number of leaders of the set L°j 
j 

~^L k : their sum for dimensions 1 to j 
*=i 

j 

-^kL k : the memory required to store the leaders of all 

the dictionaries of dimensions 1 to j with the two 
30 properties of embedding and of partial composition by 
controlled extension . 
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In the three arrays, the last column shows the 
significance of the memory reduction factor. The 
embedding property alone makes it possible to reduce 
the memory by a factor of more than 3 in dimension 3, 5 
5 in dimension 7, 1 in dimension 15. By virtue of the 
embedding property, instead of storing all the leaders 
of the D j i for the set of resolutions in dimension j, we 
store only the leaders of D j Nj _i (the leaders of Lj). The 
appending of the partial composition by controlled 

10 extension makes it possible to further reduce the 
memory as shown by the last column of the array of 
Figure 7d. The additional saving afforded by this 
property is by a factor of greater than: 
1.5 in dimension 4, 

15 3 in dimension 8, 

and 7 in dimension 15. 

As shown by Figure 7e, with respect to quantizers 
simply structured as a union of permutation codes, the 

20 use of quantizers possessing moreover the two 
structuring properties of embedding by resolution and 
of partial composition by controlled extension makes it 
possible to reduce the memory by a factor of 4 in 
dimension 3, 13 in dimension "7 and by a factor of 

25 greater than 35 for dimensions greater than 11. 

With the property of partial composition by controlled 
extension, only the leaders of L° have to be stored, the 
leaders of the {Lj} being retrieved from a 
30 correspondence table from the indices of the leaders of 
Lj to the indices of the leaders of L°. 

We now describe how to effectively implement vector 
quantizers . 

35 

To implement a vector quantizer of dimension j and of 
resolution r if it is necessary to solve the following 
three problems : 
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search for the nearest neighbour of an input 
vector in D j if 

search for the index of a codevector of D j i, 

and reciprocally, search for a codevector of D j i on 

the basis of its index. 

As far as indexation is concerned, it is indicated that 
there exists several known ways of indexing the 
codevectors of a dictionary, the union of permutation 
codes of type II. The numbering employed in the 
embodiment takes its inspiration from that used to 
index the spherical codes of the Gosset lattice. 

For any dimension j ( j e { 3, 4 , 5, 7 , 8 , 9, 10, 12, 13 , 14 , 15 } ) , 
each codevector of D j Nj -! is indexed by an offset 
characteristic of its permutation code, of a binary 
index giving its combination of signs and of its rank 
in its permutation code. The offset of a permutation 
code is the aggregate of the cardinalities of the 
permutation codes preceding it in D j Nj -i. Among the 
formulae for numbering permutations, we have chosen the 
so-called Schalkwijk formula. 

In addition to this conventional numbering of the 
codevectors of D j Nj -!, we use a correspondence table from 
the indices of the leaders of Lj to the indices of the 
leaders of L°. The leaders of L° being stored, great 
freedom of indexation of L° is thus available. For 
example, it is possible to class these leaders with 
nonzero integer components by increasing dimension. 
With each index m 3 of a leader x j of Lj is associated an 
index l m of a leader x j ' of L°. On the basis of this 
index l m , we retrieve the dimension j 1 of the leader x j ' 
and the leader itself. The leader x j is then retrieved 
by inserting (j-j 1 ) zeros as last components of x j '. 

The array of Figure 7f gives the first 23 leaders of L°. 
The array of Figure 7g gives the leaders of the 
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permutation codes of the dictionaries in dimension 3 by 
indicating for each leader x 3 , that leader x j ' of L 0 -j. of 
dimension jMj'^j) that has been extended to obtain it. 
Incidentally, it is pointed out that if j=j', then 
x j ' = x 3 . 

In Figure 7f, we write: 

-1: the index of the leader in L° (from among the 516), 
-j : its dimension, 

-1 D : its index in the leaders of L°j. 
In Figure 7g, we write: 

-m 3 : the index of the leader x 3 among the 23 leaders of 
D 3 N3 , 

-i: the index of the dictionary of smallest resolution 
to which the leader belongs (i.e. x 3 ^D 3 H and x 3 gD 3 ± ) , 
-jri: the rate per vector of this dictionary D 3 i, 
-j ' : the dimension of the leader x j ' of L° (number of 
nonzero components) , 

-l m : the index of x j * out of the 516 leaders of L°. 

Described hereinbelow are the coding and decoding 
algorithms proper in the general case and we shall see 
later the particularly advantageous case where an 
additional structural constraint (union of permutation 
codes) has been added. 

It is firstly indicated that they preferentially 
utilize the dictionary structure induced in particular 
by the property of controlled extension which makes it 
possible to reduce the complexity of the nearest 
neighbour search algorithm. In particular, the 
codevectors having the same insertion rule can be 
grouped together. For example, in the case of a 
Euclidian distance distortion criterion which will be 
treated in detail later, if L codevectors {x j i, 
1=0, 1, L-l } of dimension j of a dictionary D j ± are 
obtained by the same insertion rule 
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R (n / { (i m ,p m ) }m=0, n-1) on the basis of L codevectors xi j " n 

of dimension j-n of a dictionary Di. j ~ n , the calculation 

of the L distances of the codevectors x j ! from an input 

y-i 

vector y:Dist(y,x 1 3 )=^(y k -x J kJ ) 2 may be accelerated by 

*-o 

n-] 

5 firstly calculating the term ^(y pm - a im ) 2 then by 

calculating the L distances of the codevectors xi j " n from 
the vector y 1 of dimension (j-n) obtained by raising to 

J-n-l 

y the n components y pm : Dist (y 1 , Xi 3 " n ) = ^Cy*-*/;") 2 . 

*=o 

10 As indicated hereinabove, for each dimension, only a 
part of the dictionary of maximal resolution needs to 
be stored, the other codevectors being deduced on the 
basis of elements taken from the dictionaries of 
maximal resolution of lower dimension and of insertion 

15 rules. 

Hereinbelow is given a detailed exemplary embodiment of 
the compression coding/decoding in the use of the 
dictionary creation method according to the invention. 

20 

It is indicated firstly that instead of storing, for 
all the dimensions j to be considered, the set of all 
t he d ictionaries { D j x } ., Nj , we therefore store only the 
{ D' J NJ } as well as correspondence tables. These tables 

25 make it possible to reconstitute a codevector of D j Nj on 
the basis of its index. As described hereinabove, there 
are several ways of formulating these tables and hence 
of storing them. For example, we can, for all the 
dimensions j to be considered, tabulate for each index 

30 irtj (of a codevector x j of D j Nj ) three scalar integer 
values: j', m f and l r , where l r is the number of the 
insertion rule which makes it possible to reconstitute 
x j by partial composition by controlled extension 
applied to the element of index m 1 of the set of D %J NJ . 

35 The correspondence tables now require only the storage 
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of 3^7^. words (it is recalled that Ti j is the size of 

the dictionary Di j ). As far as the storage proper of the 
dictionaries of a vector quantizer with multiple 
resolutions and dimensions is concerned, it requires 

A' 

5 ^EjJz^ T i J words in the case of a vector quantizer not 

possessing the two structuring properties of embedding 
by resolution and of partial composition by extension, 
whereas the storage of the dictionaries of a vector 
quantizer possessing these two structuring properties 

N 

10 requires only one ^jT u NJ words, writing T j Nj for the 

size of the set D' J NJ {T J Nj ^T j Nj ) . However, in a general 
manner, T j Nj is much smaller than T j Nj , since one is of 
course seeking to favor the set D ,j Nj with respect to 
the set D U NJ . A few numerical examples of a saving of 

15 storage will be given in an embodiment described later. 

The coding algorithm which consists in searching for 
the nearest neighbour x j in D j i of an input vector 
y= (yo/ -»f yk/ yj-i) preferentially comprises the following 
20 steps: 

The step COO) consists of an initialization step where 
we put: 

d m in = VALMAX ; m min = -1; m j = 0 
25 for every index m j e[0,T j i[: 

The next step COl) consists of the reconst itution of 
the codevector x j of index m j and is preferentially 
performed as follows: 
30 a) reading of the three indices j', irT and l r in 

the correspondence tables associated with D j Nj , 
b) reading in the set D %j Nf of the vector x j ' of 

dimension j 1 and of index m f , 
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c) reconstitution of the codevector x j by 
application to x j ' of the property of partial 
composition by controlled extension according 
to the rule of insertion of index l r . 

Step C02) consists in calculating the distance d(y,x j ) 
between y and x D according to the chosen distortion 
criterion . 

The next steps C03) and C04) consist in repeating 
operations COl) and C02) to identify the index of 
vector whose distance from the input vector is minimal. 
Thus : 

* if d(y,x j )<d min then d^n = d(y,x j ) and m^n = m j 

* then, we increment m j : m j =m j +l 

* an end test is provided: 
if m j <T j i go to step COl), 
else: stop. 

In the end step COS), we determine the codevector which 
is the nearest neighbour of the input vector y in the 
guise of codevector whose index m min has been identified 
in correspondence with the smallest distance d^n with 
the input vector y. 

Thus, the algorithm continues with step C05) : 

* End 

the nearest neighbour x j of y in D j i is the 
codevector of index m,^ 

The decoding algorithm which consists in searching for 
a codevector of D j i on the basis of its index is given 
by step COl) of the coding algorithm. It is indicated, 
in particular, that the decoding involves the complete 
reconstitution of the codevector x j (operation c) of 
step COl)), regardless of the index to be decoded. 
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On the other hand, on coding, this reconstitution may 
be partial. Specifically, it may sometimes be omitted 
if the distortion criterion in the distance calculation 
of step C02) can be decomposed into two terms: 

one dependent solely on the index of the insertion 

rule, 

and another the codevector x j '. 

For example, in the case of a Euclidean distance 
distortion criterion, it is possible, in the 
initialization step COO), to precalculate, for each 
insertion rule of index l r used in D j if the distance 

d ir = ^(y pm ~a im ) 2 (if the insertion rule of index l r 

m=0 

consists in inserting j-j' components a im at positions 
p m , m ranging from 0 to j-j'-l). The calculation of the 
distance between y and the vector x j (j , ,m , ,l r ) of step 
C02) then amounts to calculating the distance: 

d(y\xi')=f i (y' k -x{) 2 , where: 

x j is the vector obtained in operation b) of step 
C01) , 

and y ! the vector of dimension j 1 , obtained by 
raising to y the j-j f components y pm , 

the distance d(y,x J ) then being obtained by simple 
summation d(y,x j )= d ir +d(y f , x j '). 

This is the reason for which we defined, hereinabove, 
as "partial" the reconstruction of a codevector x j ' of 
lower dimension j ■ than the dimension j (which would be 
the dimension of a completely reconstructed codevector 
x j ), during the coding process. 



Moreover, if a vector x j ' intervenes several times in 
the composition of codevectors of D ± j (with various 
insertion rules), we can also precalculate in the 
initialization step, the terms d(y',x j '). It is 
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therefore seen that the compromise between storage 
(temporary) /complexity of the coding can be tailored 
according to the requirement of the application. 

Likewise, the compromise between storage/complexity of 
indexation may also be tailored to the requirement of 
the application. 

For coding, in the case of the additional constraint of 
a union of permutation codes as was mentioned above, 
the nearest neighbour search algorithm, for the 
spherical codes of the regular Gosset lattice in 
dimension 8, readily generalizes by simplifying to 
these dictionaries, by union of permutation codes of 
type II. 

Such a search algorithm is described in particular in: 

"Algorithme de Quantification Vectorielle 
Algebrique Spherique par le Reseau de Gosset E 8 ", C. 
Lamblin, J. P. Adoul, Annales Des Telecommunications, no 
3-4, 1988 ["Spherical algebraic vector quantization 
algorithm by the E 8 Gosset lattice"]. 

A first simplification is afforded by the "freedom" of 
the signs of the permutation codes of type II that are 
not possessed by the permutation codes of the Gosset 
lattice with odd components. A second simplification is 
afforded by the consideration of the number of nonzero 
components of each leader for the calculation of the 
scalar product. This illustrates the utilization of the 
structure induced by the property of partial 
composition by controlled extension by the coding 
algorithm. A last modification takes account of the 
storage in integer form of the leaders of L°, thereby 
leading to the introduction into the calculation of the 
scalar product of a corrective factor equal to the 
inverse of the Euclidian norm of these leaders with 
strictly positive integer components. 
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Described herinbelow is an embodiment in which the 
search for the nearest neighbour of an input vector y 
of dimension j in the dictionary Di j utilizes, in 
5 addition to the two structuring properties of the 
invention, the aforesaid structure as a union of 
permutation codes . 

Three additional steps are provided globally: 
10 - two preliminary steps (before the reconstruction 
step C01) hereinabove) for determining the 
absolute leader | y | and the sign vector z of the 
vector to be coded (steps CP1) and CP2 ) ) , 
and a last step for calculating the rank of its 
15 nearest neighbour in the dictionary (step CPS) ) . 

The search described above is performed, no longer 
among the Ti D codevectors of Di j (i.e. no longer for m j 
«=[0,T j i[), but only over the set Lj(i) of the L Dji 
20 leaders of D x j (for m j e [0, ^/ [, writing for the 

number of leaders or permutation codes of Di j ) . 

In this embodiment, the search for the nearest 
neighbour of y in Di j amounts to searching firstly for 
25 the nearest neighbour of \y\ in the set Lj(i) (from 

among the first leaders of Lj) . As described above, 

it is not necessary to completely reconstitute these 
leaders (operation c) of step COl) ) , the distortion 
criterion (here the modified scalar product) being 

30 calculated only on the nonzero components of each 
leader. Therefore, for each leader it suffices to 
determine the corresponding leader in L° using the 
correspondence table from the indices of the leaders of 
Lj to the indices of the leaders of L° associating with 

35 each index m j of a leader x j of Lj an index l m of a 
leader x j ' of L°. 



10 
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The algorithm then preferentially runs according to the 
following example : 

* step CP1) : 

Passage of the input vector y= (y 0 , yic/ Yj-i) to its 
absolute vector I y I = ( I yo I r I Yk I r »■# I Yj-i I ) and to its 
sign vector e= ( e 0 , e k , e-j-i) with e k =l if y k ^0 and e k =-l 
else . 



* Step CP2) : 

Search for the leader \y\ of |y| by permutation of its 
components so as to arrange them in decreasing order 
*Step CP3) : 
15 *Step CoO 1 ) : Initialization: 

pS m ax = "I-/ Hlmax = "If - m 3 = 0 

for every index m j e [0, [ 

20 *Step COl 1 ) : reconstruction of the leader of index m j : 

a) reading of the index l m of the leader x 3 ' 
associated with the leader of index m j of Lj, in 
the correspondence table associating the 
leaders of Lj with those of L 0 , then 

25 determination of the dimension j ' of the leader 

x j ' and reading of the corrective factor a (with 

1 = Wm) 2 ) 

b) Reading in the set L° of the leader x j ' of 
30 dimension j 1 and of index l m . 

*Step C02 1 ) Calculation of the modified scalar product 

between | y I and x ] ': ps ( I y I , x r ) =ot2^(\y k \-x J k ) 

*=o 



35 The next steps consist in repeating the operations 
COl 1 ) and C02 ' ) to identify the index of the code 
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- m D 



leader whose modified scalar product with the absolute 
leader of the input vector is maximal. Thus: 
if ps ( I y I ,x j ') >ps max then ps max = ps ( I y \ , x 3 ' ) and m ma 



5 * next, we increment m j : m j =m j + l 
* end test 

if m j <^of go to step COl 1 ) , else stop, 



At this end step, we calculate the index of the nearest 
10 neighbour of y in D j i by the procedure of indexation of 
a union of permutation codes on the basis of the number 
of the permutation code m max found in step CP3) , of the 
rank of the permutation performed in step CP2) and of 
the sign vector determined in step CP1) . 

15 

It should, be noted that step CP2) may be accelerated. 
Specifically, if n± j is the maximum number of nonzero 
components of the leaders of Lj(i), it suffices to 
search for the n± j largest components of lyl- There are 

20 several variants of step CP3) depending on the 
storage/complexity compromise desired. If one wishes to 
minimize the number of calculations, we can tabulate 
for all the leaders of L° simply their dimension j 1 and 
their corrective factor. The determination of the 

25 dimension j 1 mentioned in step CP3) consists in this 
case in reading the correspondence table. Conversely, 
if one wishes rather to reduce the memory, this 
determination is carried out on the basis of the index 
l m . Likewise, the corrective factor may be calculated 

30 after the reading of the leader x j '. 



Thus, the algorithm for searching for the nearest 
neighbour of an input vector y of dimension j in the 
dictionary Di j , using a structure as a union of 
35 permutation codes, may be preferentially summarized as 
follows : 
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CP1) we pass from the input vector y = (y 0 , y*, Yj-i) 
to its absolute vector I y I = ( I yo I / I yk I , I yj-i I ) and to 
its sign vector e = (eor-r Zk,-, with e k =l if y k ^0 

and e k = -1 else, 

5 

CP2) we search for the leader \y\ of |y| by permuting 
its components so as to arrange them in decreasing 
order, 

10 CP3) we search for the nearest neighbour of \y\ in the 
set Lj(i) of the leaders of D j i (in fact from among the 
M j i first leaders of Lj by writing Mi j for the number of 
permutation codes of D ± j ) . As indicated above, this step 
amounts to searching for the leader of L° which 

15 maximizes the modified scalar product among the list of 
the Mi j leaders of L° indicated by the correspondence 
table from the indices of the leaders of Lj to the 
indices of the leaders of L°. If the dimension of a 
leader x j ' of L° is j' (j'^j), the calculation of its 

20 scalar product with | y | is performed only on the first 
j ' components of | y \ , then multiplied by the inverse of 
the Euclidian norm of x j '. 

CP4) and we calculate the index of the rank of this 
25 nearest neighbour of y in Di j by the procedure of 
indexation of a union of permutation codes on the basis 
of the number of the permutation code found in the 
previous step, of the rank of the permutation performed 
in step CP2) and of the sign vector determined in step 
30 CP1) . 

In short, step CP2) may be accelerated. Specifically, 
if n± j is the maximum number of nonzero components of 
the leaders of Lj(i), it suffices to search for the ni j 
35 largest components of |y|. 

We now describe a decoding algorithm, within the 
general sense, without necessarily using limitatively a 
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permutation codes union indexation described above as 
advantageous embodiment. The decoding algorithm 
preferentially takes the following form. 

5 On the basis of an index nij received, we determine 
whether this index corresponds to a codevector 
belonging to D %J Nj _ x or to D }J Nj _, . 

In the first case, nij is associated with a unique index 
10 in D' j Nj _ x , and the codevector is obtained through simple 

reading of correspondence table. 

In the second case, irij points to an element D u Nj .^ (j f <j) 
and to an insertion rule. 

The determination of whether x j m j belongs to D ,j N j_i or to 
its complement may be performed in various ways. For 
example, it is possible to use a binary indication for 
each index. It is also possible, for each resolution ri, 
to index the elements of the complement D j i_i in D j if 
beginning with the elements obtained by controlled 
extension belonging to D ,j i, followed by the "free" 
elements belonging to D 1 / . Membership in D Nj-i or in 
D' j Nj _ x is then undertaken through simple tests. Likewise, 

the insertion rule may be explicitly indexed or 
otherwise . 

For example, in the embodiments described below, the 
insertion rule is implicitly retrieved on the basis of 
30 the index. It will also be understood that the 
storage/indexation complexity compromise may be 
tailored as a function of the requirements of the 
application . 

35 We return here to the particular case of the additional 
constraint defined by the union of permutation codes. 



15 



20 



25 
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Preferentially, the decoding algorithm takes its 
inspiration from the document: 

"Algorithme de Quantification Vectorielle 
Algebrique Spherique par le Reseau de Gosset E 8 ", C. 
5 Lamblin, J. P. Adoul, Annales Des Telecommunications, 
No. 3-4, 1988, using in addition the correspondence 
table from the indices of leaders of Lj to those of L°. 

On the basis of the index of a codevector in D j ± , we 
10 determine the index of its leader in Lj(i), its rank in 
its permutation code and the sign of its nonzero 
components. The correspondence table then gives the 
index of the leader in L° which is then obtained through 
simple reading of a table stored in memory as well as 
15 its normalization factor which makes it possible to 
normalize the decoded codevector. 

Another exemplary implementation of the present 
invention is given below. This example is also based on 
20 the TDAC type transform based coder, but for a use to 
code digital audio signals sampled at 32 kHz and of 
bandwidth 15 kHz (FM band), contrary to the example 
given above of the use of the TDAC coder in wideband to 
code digital audio signals sampled at 16 kHz. 

25 

The principle of this coder is similar to that of the 
TDAC wideband coder at 16 kHz. The audio signal, band 
limited at 16 kHz and now sampled at 32 kHz, is also 
split into frames of 20 ms . This leads after MDCT 
30 transformation to the obtaining of 640 coefficients. 
The spectrum is split into 52 bands of unequal widths, 
the splitting of the wide band being identical to the 
splitting performed by the wideband TDAC coder. 

35 The array of Figure 8a gives the band splitting used 
and the resulting dimension of the vector of 
coefficients (corresponding to the number of 
coefficients indicated in the third column) . 
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The quantization of the spectral envelope also uses a 
Huffman coding and the remaining variable rate is 
allocated dynamically to the coefficients on the basis 
of the dequantized version of this spectral envelope. 

The quantization of the MDCT coefficients uses 
dictionaries constructed according to the invention. As 
in the case described previously, the dictionaries are 
also structured as a union of permutation codes. For 
dimensions lower than 15, vector quantizers are the 
same as those of the wideband. Thus, we construct 
dictionaries for dimensions 16, 17, 18, 19, 20 and 24. 
For dimension 24, this structure has moreover been 
combined with the Cartesian product structure. The last 
top band of 24 coefficients is split into two vectors 
of dimension 12: one is made up of the even 
coefficients, the other of the odd coefficients. Here, 
the vector quantizers constructed for dimension 12 have 
been utilized. 

The array of Figure 8b gives the number of different 
resolutions as well as their values for dimensions 1 to 
24. 

The present invention thus provides an effective 
solution to the problem of vector quantization at 
variable rate and variable dimension. The invention 
jointly solves the two problems of variable resolution 
and variable dimension by providing a vector quantizer 
whose dictionaries, for the various dimensions and 
resolutions, possess the structuring properties PR and 
PD hereinabove. 

For a given dimension, the embedding of the 
dictionaries guarantees, on the one hand, the local 
decreasing of the distortion as a function of 
resolution and reduces, on the other hand, notably the 
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quantity of memory required for storage since the 
dictionaries of lower resolutions do not have to be 
stored, all the elements of these dictionaries in fact 
being in the dictionary of maximal resolution. As 
compared with the vector quantizer structured as a tree 
of Figures la and lb, the choice to embed the 
dictionaries therefore already affords two advantages: 
the assurance of a decrease in local distortion as a 
function of increasing resolutions and reduced storage. 
It also allows great fineness of resolution with, if 
necessary, a granularity of less than a bit, 
facilitating the choice of dictionaries of sizes that 
are not necessarily equal to powers of 2. This fine 
granularity of the resolutions is particularly 
beneficial if several vectors of variable dimension 
and/or variable resolution are to be quantized per 
frame, by associating an algorithm for arranging the 
indices as a binary train with these noninteger vector 
based rate quantizers. 

The embedding property PR of the dictionaries implies 
that it is only necessary to store the dictionaries of 
maximal resolution. By virtue of the second property 
PD, the quantity of storage memory is even more 
reduced. Specifically, part of the elements of the 
dictionaries of maximal resolution does not need to be 
stored since it is deduced from elements taken from the 
dictionaries of maximal resolution but of lower 
dimension, taking account of predefined insertion rules 
{R m }. The proportion of elements thus structured is 
readily adaptable and makes it possible to finely 
tailor the quantity of storage memory. 

The structure induced by these two properties PR and PD 
therefore makes it possible to advantageously reduce 
the storage memory required. It may obviously be more 
so by imposing additional structural constraints on the 
dictionaries, such as those already mentioned in the 
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introductory part with reference to the prior art 
hereinabove. In preferred embodiments, there is 
provision for example for the use of spherical vector 
quantizers, the union of permutation codes, combined as 
appropriate with the Cartesian product structure 
described hereinabove. 

As compared with algebraic vector quantizers, this 
structure of dictionaries that is induced by the two 
properties offers very great flexibility of design both 
in respect of choice of dimensions and in respect of 
choice of resolutions. Moreover, these vector 
quantizers adapt to the statistic of the source to be 
coded and thus avoid the problem of the tricky design 
of a "vector companding" that is obligatory in 
algebraic vector quantization so that the distribution 
of the source to be coded is rendered uniform. 



